The county was formed in 1858 from land given by Madison, Estill, Owsley, Clay, Laurel, and Rockcastle counties. It was named for Andrew Jackson, seventh President of the United States.